DOCUMENT RESUME 



ID 213 031 

AUTHOR ^ 
TITLE 

INSTITUTION 
PUB DATE 
MOTE 

EDRS PRICE 
DBSCRIPTOkS 



IDENTIFIERS 



CS 206 747 

Koziol, Sttphtn M,, Jr. 

Oral Conpoting. Coanunication Skills* PCRP Asaessment 
Survay III* 

Ptnnaylvania Stata Dapt. of Education, Harriaburg. 
82 

34p.; For ralatad documanta aaa CS 206 745-749. 
MF01/PC02 Plua Poataga. 

Comunication Skilla; Educational Aaaaataiant; 
ElaaMintary Sacondary Education; Evaluation Nathoda; 
Languaga Arta; *Oral Languaga; ^Progran Evaluation; 
^School Survaya; *Salf Evaluation (Individuals); 
Spaach Coaaiunication; Taachar Ef factivanaaa; *Teachar 
Evaluation; ^Taaching Nathoda; Writing Procaaaaa 
Aaaaaaa^nt Inatrumanta 



ABSTRACT 

Thia packat ia tha third of five davalopad as a aat 
of aalf-appraiaal inatrumanta with which taachara (and otha^) can 
ayatanatically axaaiina thair inatruction nathoda in comaiunication 
akilla. Tha packat containa forna for taachara, students, 
adaiiiuatratora, and paranta addraaaing two lavals of specificity: . 
raapcnaaa to tha overall coamunicatioq akilla progran and responses 
to a teacher* a practicea and policies within a single kind of class 
situation. Thia packet on oral compoaing ia divided into ten sections 
aa followa: (1) reaching for achoo^ improvement, (2) administering 
the teacher survey, (3) teacher response form, (4) the tabulation 
guide outline for the teacher response form, /S) tabulating responses 
from tha teacher aurvey, (6) admin^ ^"aring the student survey, (7) 
student response form, (8) administering the parent and administrator 
aurvey, (9) administrator response form, 4nd (10) parent response 
form. (HOD) 



*********************************************************************** 

* Rep; OQUctions supplied by EDRS are the best that can be made * 

* ^ from the original document. * 



UM, ovMman op iducatiom 

NATIONAl INSTITUn Of CDUCATION 

EDUCATIONAL B€SOURCES INFORMATION 

^ CENTER lERiC) 

^^hm document has bten rtproductd as 

ftcttved from person of ofQaniZition 

ongmattng i( 
^^H^txot chenges have been made to impfove 

reproduction quality 

• Points of vew or opinions stated »n this docu 
ment do not nAessaniy represent offt. al NiE 
position or policy 



Communication Skills 



PCRP 

SI HI EY III 

Oral €!omposing 



"PERMISSION TO REPRODUCE THIS 
MATERIAL KA& BEEN GRANTED BY 

Pennsylvania State 
Dept, of Education 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) " 



By Stephen M. Koziol, Jr. 
Univefsity of Pittsburg 
for the 

Pennsyhfania Department of Educaticm 



Winter 1982 Working Edition 



The Goab of Quality Education 

This publication directly addresses the goal of communication skills. 



The Planned Course 

This assessment survey should assist those designing planned course in 
identifying objectives, content, expected levels of achievement and evaluation. 



ConunoQwealth of Pennsytvanui 

Dick Thomburgh, Governor 

Department of Education 

Robert G. Scanlon, Secretary 

Office of Basic Education 

Ronald H. Lewis, Commissioner 

Bureau of Curriculum an^ Instruction 

David Campbell, Director 

Division of Goals and Instruction 
Helen A. McLain, Chief 

John L. Meehan, Senior Program Adviser, Communication Arts 
David T. Chestnut, Language Education Adviser 
Thomas O. Mullikin, Language Education Adviser 

Pennsylvania Department of Education 
333 Market Street, P.O. Box 911 
Harrisburg, PA 17108 



The Pennsylvania Department of Education, an equal opportunity employ- 
er, will not discriminate in employment, educational programs or activities, 
based on race, sex, handicap, or because a person is a disabled veteran or a 
veteran of the Vietnam Era. This policy of nondiscrimination extends-to 
ail other le ally protected classifications. Publication of this policy in this 
document is in accordance with state and federal laws including Title IX of 
the Education Amendments of 1972 artd Sections 503 and 504 of the Re- 
habilitation Act of 1973. Inquiries should be directed to Susan Mitchell, 
Affirmative Action Officer, 503/504 Coordinator and Title IX Coordinator, 
Education Building, 333 Maricet Street, P.O. Box 91 1, Harrisburg, PA 17108 
(717-787-1953). 



TABLE OF CONTENTS ^ - 



!• Reaching for School Iiq^rovement 1 

II. Administering the Teacher Survey 8 

III* Assessment Survey III - Teacher Response Form . - . 9 

IV. The Tdbulation Guide Outline for 

the Teacher Response Form 16 

V. Tabulating Re<;pon8es from the Teacher Survey ... 18 ' * 

VI. Administering the Student Survey 22 

VII. Assessment Survey III - Student Response Form ... 23 

VIII. Administering the Administrator 

and Parent Surveys 26 

IX. Assessment Survey III ^ Administrator 

Response Form 27 

X. Assessment Survey III ^ Parent Response Form ... 28 



This is a working document to be used by the 
Department 'Vith schools and school districts 
across the Commonwealth. It is subject to 
further evaluation and revision based upon 
the outcomes of implementation activities. 



4 



PREFACE 



This is the third of five survey packets developed for the purpose of 
gathering accurate, detailed data about instruction in communication skills in 
a single classroom or course. These packets were designed for language arts 
teachers, English teachers and all other teachers engaged directly in teaching 
coamunication skills as well as for their students, the parents of their 
students, and their administrators. 



The five PCRP assessment surveys parallel the critical experiences of 



PCRP: 



Assessment Surveys ^ 

Survey I - Literature 
Survey II • Written Composing 
Survey III - Oral Composing 
Survey IV - Language Proficiency 

Development 
Survey V - Sustained Silent Reading 



PCRP 

Response to Literature 
Oral and Written Composing 

Investigating and Mastering 
Language Patterns. 
Sustained Silent Reading 



Before a new curriculum is developed or an old one revised, those involved 
should have knowledge of the current operational curriculum at their school or 
district. One way to obtain that knowledge is through assessment surveys which 
are comprehensive, but not prescriptive. These surveys must be designed in a 
way that those who take the time to answer them find personal benefit in the 
activity and are confident that the completed forms will yield accurate and 
beneficial information to curriculum planners. For the individual respondent, 
these surveys are a vehicle for reflection and learning - actively involving 
them in the reconstruction of their in itructional program in order to know and 
understatid it better. With an understanding of what they are doing, what their 
expectations for student learning are, and how in practice they define their 
area ot instruction, they should be able to evaluate their instructional 
programs and plan improvements. 

Although the surveys are vehicles for individual teachers to examine and 
reflect upon their own curriculum design and instructional strategies, they are 
also' valuable tools for schools engaged in LONG RANGE PLANNING FOR SCHOOL- 
IMPROVEMENT. If a school or district decides that its priority goal is com- 
munication skills, the use of these surveys with their staff can provide a base 
of data from which to proceed. Analysis of completed surveys should yield 
information concerning purposes, practices, emphases, use of materials, eval- 
uation of students, and program support. 

For further information about or assistance with these surveys, contact 
either of the following; 



Pennsylvania Department of Education 

c/o John L. Meehan 

Box 911 - 333 Market Street 

Harrisburg, PA 17108 

Telephone: 717-783-3946 



Dr. Stephen M. Ko;iiol 
4P24 Forbes Quadrangle 
School of Education 
University of Pittsburgh 
Pittsburgh, PA 15260 
Telephone: 412-624-1348 



*Each of the surveys has four separate forms, each for different respondents: 
teachers, students, administrators and parents. 
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I. REACHING FOR SCHOOL IMPROVEMENT: THE PCRP ASSESSMENT SURPYS 



School Improvement is the major educational effort for the 80*8 in Penn- 
sylvania. As part of that effort considerable attention has already been 
focused on the assessment of students' skills or conqpetencies including such 
statewide efforts as Project 81 and the EQA* At primarily local levels » 
curriculum revision emphasizing the content of the curriculum is an ongoing 
process of change reflecting current perceptions of 'what- is and is not im- 
portant for students to learn. While both of these kinds of efforts have the 
potential to influence the general pattern of education that children receive , 
they ignore to a large extent the most ijmediate influence on students' school 
learnings the classroom situation, and the person who substantially determines 
what happens there » the teacher. 

Anyone familiar with elMeatary or secondary school teaching quickly 
realizes that John Donne's famous assertion that, ^No man is an island entire 
of itself;" hardly describes the daily professional reality for most classroom 
teachers. How often do teachers have people visit their classrooms with the 
primary purpose of helping them improve as teachers, that is, to help develop 
and refine their skills as a language arts or English teacher? If the situ- 
ation is typ'>al» the answer is, "Never!" This is not to say that teachers 
have not been "observed" or "evaluated" by someone, for certainly some form of 
regular teacher observation and evaluation ^eems to be part of the operating 
procedure in nearly every school discrict. *ut observation and evaluation 
procedures are substantively different from "supervisory" strategies aimei^ at 
.teacher improvement* What then are the means for helping classroom teachers 
improve what and how they do in the classroom? 

The availability of professional journals and texts as well as various 
professional conferences and workshops provides two very important kinds of 
resources for teachers interested in improving their work in the classrooa. 
Hopefully, these will continue to exist especially as ways for teachers to 
expand their views about successful teaching approaches. Yet, reliance on 
these kinds of resources alone will not likely alter significantly either the 
overall quality of instruction or the pattern of instruction for individual 
teachers. To change anything sensibly requires more than an idea about and a 
commitmeL to a new practice or policy; it also require^ an understanding of 
the practices and policies already in place, an understanding of what will be 
replaced in classroooi procedures, and ^n understanding of what the "new" 
pattern of instructioa will be. That is, it is nonsensical to believe that one 
can introduce something new into instruction without eliminating something that 
already existed or that introducing a new policy does not alter the overall 
pattern of instruction. Indeed, a prevailing dilemma for most teachcg^s wanting 
to introduce some change in instruction is determining what to remove from the 
existinf; pattern, when to introduce the new practice, and for whom and how. 

These latter kinds of determinations almost necessarily need to be made at 
a local level within a school, at a specific grade, or by the teacher within a 
particular class. To begin :hehe determinations systematically, however, still 
requires an understanding of what already is in place, i.e., what the existing 
practices and policies are for the individual teacher or fefr all the language 
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arts and English teachers working with a particular grade level or at a parti- 
cular school. A fundamental problem at this stage, however, is how to obtain a 
comprehensive view of current practices and policies in anyclass. 

Operationally, there are two basic means for obtain ng detailed infor- , 
mation about cfassroom practices and policies: (1) from a skilled observer^ 
recording what happens, and (2) from the teacher directly through a self- report 
process. Historically, neither of these has been very successful. Direct 
observation is time consuming and very expensive, and both of these factors 
have limited the frequency with which this approach has been used and the 
overall meaningfulness of information obtained. Teacher self-report is more 
practical but suffers from consistently low reliability. That is, as carried 
out^ the self-report process hcs generally shown that teachers are not very 
good at accurately describing what they do. It is important to note, however, 
that underlying both of these approaches is the lack of any comprehensive 
mechanism to observe or report practices and policies specific to the teaching 
of language arts or English. Observers have had to rely on general observa- 
tional instruments such as the Flanders Interaction Analysis and teachers in 
the self-report process have usually been asked to characterize only their 
overall pattein of instruction rather than the specific practices and policies 
in particular classes. 

It was with these problems clearly in mind that the Pennsylvania Depart- 
ment of Education began a project dealing with the delineation of practices and 
policies in communication skills instruction. Specifically, the intent was to 
have developed a set of self-appraisal instruments with which teachers and 
others involved with influencing the qual?ty of communication skills instruc- 
tion could examine systematically what they were doing as part of or in support 
of that instruction. 



1. Selecting the Audience 

One of the first decisions made was to develop separate instruments for 
each of four key audiences - the classroom teacher, students, school adminis- 
trators, and parents. 

As noted at the beginning of this section, sensible strategies for school 
improvement must begin with an understanding of what is already happening 
ulthin individual classrooms. Mhile the availability of materials, the exis- 
tence of curricular goals, and the presence of competency tests as well as the 
attitudes and approaches taken by parents and administrators each can influence 
the overall nature and quality of instruction, it is the classroom teacher who 
plays the pivotal role in detennining what kinds of learning opportunities will 
be available in the classroom. 

While it is certainly true that communication skills teachers play the 
crucial role in determining what happens within the walls of their classrooms, 
it is also true that students, administrators, and parents can and probably 
ought to be supportive of teachers' instructional efforts. 

The PCRP Assessment Surveys represent a direct effort to provide adminis- 
trators and parents with a means to consider the extent to which they do or 
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could play constructive roles in the Reading and Coanunication Arts Program in 
their schools. The student surveys also represent a direct effort to provide 
cofliiunication skills teachers with means for validating their own perceptions. 

Activities listed on the student response forms were carefully selected 
from the longer detailed teacher forms to represent a thorough sampling of the 
various categories in each critical experience domain. Students respond on the 
forms only in terms of the frequency with which the activity occurred in their 
class during the year. 

Everyone views events and processes from particular points of view; at 
times, everyone sees what he/she wants to see not necessarily what is. The 
compatability of the teacher and student response forms (i.e., that they use 
the same type of response format and that the content on the student form is 
tied to that on tLe teacher form) enables teachers to validate their own 
perceptions about what is happening in their classrooms. When the teac.her*s 
perceptions of his/her classroom activities and students* perceptions of those 
behaviors are reasonably consistent , that teacher can be confident in the 
accuracy (or validity) of his/her self-perceptions. When those perceptions are 
drastically different, the validity of the teacher's or the students* percep- 
tions becomes open to question. Lack of validation, however, does not mean 
that the teacher is doing something wrong. It means only that the teacher and 
the students differ considerably in their perceptions about what has been going 
on in the class and that further examination and reflection is needed. 

Thus, although the teacher self-report Instrument is by far the most 
comprehensive, the student, the administrator and the parent surveys reflect a 
set of practical and important supportive behaviors and, indirectly at least, 
encourage the inclusion of those potentially influential groups in the overall 
school improvement process. 

Rigorous self-examination is seldom either a pleasant or a simple process. 
Yet, the encouragement of such behavior on o regular basis by those directly 
influencing classroom instrvctiem spears to be a crucial ingredient for 
continuing school irprovement. 



2. Specifying the Purpose 

A second decision was that the self-appraisal instruments were to be 
descriptive rather than prescriptive or evaluative. With the teacher form, for 
example, the intent was that, whether the instrument was to be used by the 
teacher alone, by the teacher as part of a group at a grade level or school, or 
by the teacher in conjunction with the supervisory efforts of a department 
chairperson, principal, or curriculum coordinator, it was to describe classroom 
practices and policies not dictate them. It was to provide an information base 
for teachers from which they could make intelligent decisions about the nature 
of their classroom instruction. In that sense, the responses in themselvet do 
not direct change. Rather, the motive for change must come when teachers 
decide that the existing pattern of instruction i^ either internally inconsis- 
tent or is inconsistent with what they perceive to be the appropriate prior- 
ities or values for that class or school. A basic "GIVEN" is that those 
priorities or values will differ from class to class, teacher to teacher, 

/ 

'- 3 - 

8 



school to school, and district to district. Thus, the assessment surveyis 
provide a base of information from which decisions can be made at the indivi- , 
dual class, school, and/or district level. 



3. Relationship to PCRP 

A third key decision was to coordinate the self-appraisal process at least 
conceptually with the existing framework of the Pennsylvania Comprehensive 
Reading/Co munication Arts Plan (PCRP).. Although the new self-appraisal 
instrujner^cs are not in any way direct assessments of PCRP or restricted to 
teachers implementing PCRP, the idea of the four critical experiences (Respond 
to Literature, Composing: Oral and Written, Sustained Silent Reading, and 
Developing Language Proficiency) provided the organizing base for the new 
self-app]caisal instruments. 

4. Focus of Instruments 

A fourth de:i8ion was to strive to make the instruments comprehensive 
rather than cursory. One ramification of that decision was the realization 
that a single general instrument was out of the question. There was simply no 
way to elicit a detailed description of instructional policies and practices in 
each of the four broad PCRP-related areas across grade levels through a single 
instrument without having that instrument absurdly long. As a result, it was 
decided to develop five separate assessment surveys , one each for Responding to 
Literature: Written Coirposing: Or^l Composing; Developing Language Pro- 
ficiency; and Sustained Silent Reading. Separate forms for elementary teachers 
and secondary teachers were not developed because, quite surprisingly, there 
was no sound empirical base upon ^hich to ^etermin'^ that certain kinds of 
practices and policies would be restricted to orle level or the other. Thus, 
the resulting detailed teacher forms for each area, while still lengthy, are 
available for use by elementary and secondary teachers of communication skills. 
Moreover, if there is the opportunity for Researchers to compare response 
patterns from teachers across grade levels, and/or across schools, we .may 
finally begin to get a mucli greater understanding qf the overall patterns of 
communications skills experiences for children as they move through pur 
schools. , That is, we may be able to extend our current understanding based 
largely on inference from curriculum guides, textbook use, and informal teacher 
comment with more concrete details about instructional decision-making and 
in-class beha^aors. 



5. Straight forward Language 

As work on the various PCRP Assessment Surveys progressed, a number of 
operational decisions were made about format and approach. Foremost, 1 be- 
lieve, was the decision to make every effort to be jargon-free. This was no 
trivial matter no^ has it been particularly easy to accomplish. To a certain 
extent, every profession has a technical vocabulary relatively unique and 
special to that profession. Competent individuals in that profession are 
expected to know, understand, and use that vocabulary. The problem is deter- 
mining what indeed is part of the on-going professional vocabulary and what is 
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professionalrlike jargon. In any case, efforts werejnade to keep the language 
io the sur^ys specific and' straightforward with 'a full awareness that lack of 
coacis^ecs was a*possible companion. 

6. The Two Layers of Specificity 
* 

Although earlier self-appraisal efforts had asked teachers to respond 
abq)it their -general classroom practices, the decision made with the PCRP 
Assessment Surveys was to have each teacher respond in terms of .a specific 
teaching^ assignment. At 'tke beginnincg of each, survey, the teacher is asked to 
specify a , typical recent grade level assignment and to identify what general 
type of student grouping procedure (e.g., academic, vocational, heterogeneous, 
etc.) characterized that assignment. All subsequent responses on the survey 
ajre then in terms of his/her practices and policies iu the kind of class 
identified. Thus» there are two separate layers of specificity: 

^ 

Responses are focused' on behaviors specific to clearly identified 
aspects of the overall communication skill program (i.e.. Responding 
to Literature, Written Composing, etc.). 

. Responses are focused on a teacher's practices and policies within a 
single kind of class situation. 

Each of the detailed teacher forms is subdivided into sections related to 
what appear to be distirrt components of instruction in that area. In PCRP 
Survey I: Practices and Policies in Responding to Literature, for example, 
there are ten main sections: 



I. 


Background Information 


II. 


Types of Inclusion 


III. 


Purposes for Literature Study 


IV. 


Selecting Literature for Study 


V. 


Pre-reading and Pre-viewing Practices 


VI. 


Encountering the Literature 


VII. 


Responding to Literature 


VIII. 


The Response Environment 


IX. 


Evaluating Students* Knowledge About and Understanding of 




Literature 


X. 


Supporting the Response to Literature Program 



Coiq>leting all ten sections of the survey takes approximately 2%^0 
miniites. While it seems sensible to complete an entire survey at one time, 
completing individual sections permits a teacher to focus on special sections 
at different times during the year. For example, an 8th grade teacher es- 
pecially concerned about using a variety of prereading activities might com- 
plete Section V of PCRP Survey I after each unit cf instruction in each class 
as a means for monitoring both the variety and the frequency of these kinds of 
activities vhile another teacher working with 5th grade students might focus 
attention on the range of students' opportune' tif's to respond to literature and 
UBt Section VII of the survey as a weekly check or guide. Once again, there is 
no one way for teachers to use the Assessment Surveys. The main thing is that 
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they are available for teachers to use constructively as part of a systemati^ 
self- improvement process. , \ ' ' ^ ' 

In contrast to most sel^-^i;aisal surwys, the PCRP Assessment Surveys 
also include an organizational structure withiNi each section as welj. as withia 
eac^- survey. In PQRP Assessment Survey II: Prtctices and Policies in Written 
Composing, for example, Section V: ^rewriting Adtivitie| including^^S sepaifate^ 
items reflecting five major clusters of prewriVing activities: (i KVcrbal 
Interactive Strategies such as leading a discussioA with students about a topic 
and leading a'- "brainstorming" session about a \ range of yriting topics; 
(2) Model and Form Strategies such as^ presenting students with professional 
examples or using other students* work as .models ;\ (3) Self -genera ced Notes 
Strategies such as usiag sustained writing or joiixnal writing* activities; 
(4) DirecT Experience Strategies such as taking studeftts on guided field trips 
or using dramatic enactment situations; and, (5) Mediated Experience S trategies 
such as using films or m6vies about a topic Oi. relying on students* extensive 
reading. It is important to note here that the range ctf items in each section 
does not mean that every teacher should be using -evefly kind of activity or 
procedure. Rather, the array of items provides a perspective from, which the 
teacner can decide whether the pattern of practices andlpolici#s in that area 
is reasonable for the kind of class iuentified and whither that pattern is 
consistent with perceived school and district goals and priorities. 



7. Defining Jtesponse * ; 

Finally, it was > decided that the common practice of having individuals 
respond to items with simple yes/no indications was insufficient. It does seem 
to matter whether a practice or policy is done once or twice a year or aone 
regularly. As a res^i^t, individuals are asked to respond^ to most of the items 
in terms of the frequency with which they do that kind of/beha^vior in the kind 
of class identified. Specifically, teachers are <?irected to respond to items 
aS follows^: 



0 = Never 

1 = Infrequently 

2 = Sometimes 

3 = Regularly 



- means that, this is not something, done in the type 
of class rdentified 

rs 

- means that the behavior is done no more than 3 or 
4 times a year 

- means that the behavior i& done at least 5 or 6 
tiipes a year but not as a regular practice 

- means that the behavior is done 'throughout the 
^.•year as a regular practice 



The student, the administrator and the parent forms include a similar 
response format. Once again, this kind of response format in itself makes no 
judgment about whether an indicated frequency is or is not "good." That kind 
of judgment must be made by the individual according to perceived priorities, 
values, and goals set at the local level. 
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8. Fiual Thoughts 

I have attempted here to describe sbme^of the background leading up to the 
developaent of the i^CRP Asses sipent Surveys and some of the main features of the 
surveys themselves. In particular, responses from teachers coiiq>letiag initial 
drafts of the detailed teacher surveys have been very encouraging. 

Mot only does .it rippear that complet^'v^j the survey-- nurtures sel'f- 
examinatipn, but it also seems th^ the surveyt provide for teachers very 
detailed catalogues of an extensive rai^ge of teachiug activities or^ap^d into 
clear and understandable, tate^ories. In a very real sctoe, each survey is a 
framework for helping teachers understand how p^rts various strategies and 
approaches^ interrel^ate and a basis for helping thetf integrate, new ideas and 
techniques into a coherent inst junctional {lattem. \ 
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, • ' ii; ADMINISTERING JHE TEACHr.R SURVEYS . 

»» 

The Teacher Surveys in each of the five domains of PCRP are lengthy; each 
takes between 25 and 30 minutes to complet^ ^ 

^ An ia-person administration to a group of teachers is preferable tc an 
independent or self -administered use of a survey because^: (1) questions about 
the meaning of particular items can be dealt with immediately, and (2) teachers 
can be reminded at several times to keep a single class in mind when they 
respond to items. This latter point, is extremely important since it is the 
focused context that makes ^i% kind of surv^ process meaningful and 
reasonably acrurate. This doeWnot preclude individual or self- administration 
nor is it intended to minimize the value of cosspleting a survey for the in- 
dividuals It is simply to indicate that group administration is more ef- 
ficient; especially when there is interest in group^, school, or" district 
patterns of instruction. 

When dealing with questions about ipdividual items, it is useful to 
clarify what a term or a procedure means generally, including the use of an 
exaiQ>le or illustration. However, extended definitions or examples or biased 
explanations (i.e., explanations whxch clearly reveal that the person admin- 
istering the survey either approves of or disapproves of tL^ activity) should 
be avoided. 

It is helpful,, to remind teachers while they are completing Sections 1 
and 5 that they should focus on their practices in a single class-section 
during the year and thSt they should not be concerned that their "estimates" of 
time^^location will not be^ exact. The recording of a reactive impression 
aboi*«i«e seems to yield rather accurate estimates. In general, it is helpful 
to have the teachers respond quickly to items throughout the survey rather than 
spend time pondering how many times exactly they used an activity during the 
year. The focused nature of the domains, the focus on activities within a 
particular class section, and the emphasis on rapid -response cont^ibut^ to an 
accurate self-report ^system. J 



A frequently asked question from teachers taking the survey deals with 
multi-purpose activities i.e., what do I do when I have my students doing 
oral projects in literature study — is that oral composing or response to 
literature time? or When I use literature to stimulate writing, do I count 
that as literature study time or writing instruction time? If activities 
involve effort in more than one domain, it is perfectly reasonable to tabulate 
that effort in -ach domain. As a result, it i$ possible to have the "estimate 
of time devoted to different domains of instruction in English/ language arts 
exceed 100. percent for the sum of the five PCRP domains. In a very real sense, 
the presence of multi-purpose activities is a good indicator of the teacher's 
sensitivity to and skills in the integrating of learning activities within the 
curriculum. 
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ORAL 
TEACHER 



ML ASSESSMENT SURVEY 111: TEACHER RESPONSE FORM 

Oral Composing 

I. Background Infomation * 

1.01 Name or Identification Code Number ' 

1.02 Number of Years Teaching Experience 

1.03 Highest Degree Attained \ 

1.04 If you teach at more than one grade level, please select only 
one as the basis for your . response on this survey. 



Grade Level 

For all remaining questions, answer in terms of a "typical 
class at that grade level. 

1.05 Type of Class: Academic (also high, a<ivanced, colle-e 

preparatory, etc.) 

Low Ability (also slow, ranedial, non- 
college preparatory, etc.) 

Vocational fal^o business, technical^ etc.) 

Heterogeneots (also mixed ability, regular, 

general^ rar^dom, etc I) 



1.06 For the type of class you have idrnitified, what is the average 
length of a class period in Langvaje Arts/English? (NOTE: Do 

Not include time set aside formally for Beginning, Developmental, ^ 
or Remedial Reading instruction.) ^ 

minutesjper^^ay 

1.07 Ab^ut how much time have you spent in oral composing activity 

in your class this year? (Inclui'^e in yoar estimate any time spent 
in studying about, preparing for, doing, ind listening to students' 
oral presentations in the classroom.) (check one) 

less than 1 hour per week 

about 1 hour per week 

about 1 and 1/2 hours per week? 

about 2 hours per week 

iLDre than 2 hours per week 



1.08 Please estimate how many different oral composing assignments you 
give during the year to students in the kind of class you have 
identified. 



^ '^tnnsylvania Department of Education - S. H. Koziol 
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Type of Assignnents 


Nufflber 


of 


Assi 


ftnments 


per 


year 






0 


1 


2 


3 


4 


5 




a. 


Memorized Presentation of Text 
Material (e.g., poems, speeches, 
essays, play parts, etc.) 


















b. 


Menorized Presentation of Original 
Material (i.e., work that the student 
has developed hin/herself) 


















c. 


Prepared Presenilation of Text 
Material 


















d. 


Prepared Presentation of Original 
Material 


















e. 


Inprovised Presentation of Text 
Material ^ 


















f. 


Isprovised Presentation of Original 
Material 



















DIRECTIONS FOR COMPLETING THE REMAINDER OF THE SURVEY. 

You will be asked to respond to a number of statements relating to many 
different aspects of practices and policies within your orr*i composing 
program. Please ^se the following key in making your responses: 

0 = NEVER - means that this is not something that you do in the 

type of class identified. 

1 = INFREQUENTLY - means that while this is something you may do during 

the year, you do not do it very frequently (three or 
four times a year or less), at least in the type of 
class you have identified. 

2 = SOMETIMES - means that this is something you may do at least fiv( 

or six times during the year but not on any regular 
or consistent basis in the type of class you have 
identified. 

3 = REGULARLY - means that this is something that you do as a regul^ 

or consistent part of your teaching in the type of 
class you have identified. 
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PLEASE PLACE THE NUMBER INDICATING YOUR RESPONSE IN THE SPACE TO THE LEFT OF 
EACH STATEMENT. 

II. Purposes for Oral Composing. To what extent does each of the purposes 
below play a part in the oral composing program for the type of class 
you have identified? 

(0 = Never; 1 = Inf requentl/; 2 = Sometimes; 3 ^ Regularly) 

In carrying out my oral composing program, I select and arrange 
activities in order U develop my students': 

1. unde^(rstanding of fotxal rhetorical patterns. 

2. abilities to think critically. 
3. personal aesthetic and imaginative sensibilities. 

4. knowledge of a variety of rhetorical styles and modes. 

5. understanding of how spec^^ic rhetorical aad literary forms work. 
Q ]^ ' 6. abilities to analyze a speaker's intents and arguments. 

' 7. organizational and reasoning abilities. 

8. abilities to understand the ieelings, ideas, and attitudes of 

individuals different trom themselves. 
9. understanding of stylistic devices used in specific cypes of 
oral presentations. 

10. understanding of their own ideas, feelings, and attitudes. 

11. self-confidence and personal assurance in oral expression. 
A2. abilities to carry ouL necessary oral communication tasks ex- 
pected of an educated adult. 

III. To what extent do you incorporate any of the following activities 
as means for preparing students for oral composing work? 

(0 = Never; 1 = Infrequently; 2 = Sometimes; 3 = Regularly) 

In preparing students for oral composing assignments, I: 

13. lead class discussions of the content to be developed in the oral 
conposing assignment. 

14. hold general Class discussions about the kinds of topics students 

can use for orcil composing assignments. 

15. lead "brainstorming" sessions on specific topics or assignments. 

/ 16. have f^tudents meet in small groups to discuss ways of developing 

various topics for assignments. 

17. have students listen to recorded examples or models from pro- 

fessional sources. 

18. give demonstrations of how specific types of assignments can be 

carried out. 

19. have students listen to recorded examples or models from other 

students. 

20. give students explanatory notes or information guidelines for 

carrying out the assignment. 
21. give students content outlines that they ran use in completing the 

assignment. 
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22. have students keep personal journals or logs from which they can 

draw on for ideas for their assignments. 
23- have students keep sensory detail, reaction, or impression lists 

for use in their assignments. 
24. have students make outlines before doing oral assignments. 
~' .25! have students prepare complete texts in writing before presenting 

oral assignments. 

26. have students do oral "warm-up" exercises before doing oral 
presentations. 

27. have students do creative dramatics, improvisation, role playring, 
^ etc., to stimulate or clarify ideas for assignments. 

28. have studeats examine "physical objects" related to the specified 

oral composing assignment. 

29. take students on field trips to stimulate or clarify ideas for 

assignments . i • r 

30. bring in outside speakers or guests to help stimulate or clarify 
students* ideas for oral composing assignments. 

31. use media resources (e.g., films, pictures, television, radio, etc.) 
to h^lp students get and develop ideas for oral assignments. 

32. encourage extensive reading in school and at home as a basis for 
stimulating or clarifying ideas for oral assignments. 

IV- To what extent do yon have students engage in the following kinds 
of oral coEiposing tasks? 

(0 ' Never; 1 = Infrequently, 2 = Sometimes; 3 = Regularly) 

As part of my oral composing instruction, I have stadents: 

33. use their own cassette tapes to keep personal "oral" journals 

about their ideas, feelings, perceptions, and values. 
^34. express thier ideas and feelings by doing "oral letters" to 

close friends using cassette tapes. — 

35. orally give eye-witness accounts of their observations. 

36. give oral narratives about penrsonal events or experiences. 

37. give descriptions of persons, places, or things from their 
own experiences. 

38. give explanations of their opinions or conclusions about 
eventa or issues. 

39. give presentations co&iparing or contrasting events, ideas, 

opinions, etc, ^ 

40. give expository presentations expressing someone else s point 

of view. 

41. give presentations trying to persuade others to accept their 
opinions or views. 

42. give presentations trying to persuade others to accept an idea 
or opinion different from that of the speaker. 

43. give presentations to show that Hey have mastered content 
studied in class. 

44. give presentations to show that they have mastered content 
studied outside of class. 

17 
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45. give oral reports based on their independent or personal reading. 

46. give oral reports based on their individual research or study. 

47. individually or in groups give prepared "dramatic" readings of 
short stories, poems, or other literary selections. 

48. engage in improvised individual or small group storytelling 
exercises. 

49. participate in improvised enactments of scenes, problem situations, 
current events. 3tc. 

50. memorize and enact original or published scripts. 

51. memorize and present orig?nal or published poems or stories. 

52. practice doing presentations which use specific organizational 
patterns (e.g., narrative sequeace, point and counter-point, 
thesis statement and examples, etc.). 

53. practice doing presentations that use specific stylistic devices 
(e.g., controlling volume, including humorous anecdotes, sarcastic 
unders tatement , etc . ) « 



V. To what extent do your students give oral presentations to different 
audiences? 

(0 = Never; 1 = Itf requently; 2 = Sometimes; 3 = Regularly) 

As part of my oral composing program, I have students: 

54. do improvised or prepared presentations for their own enjoyment 
(either individual) or small group presentations when there is no 
external audience). 
55. develop oral assignments for presentation to close friends. 

56. do their presentations for me for evaluation pu'^oses.^ 

57. do their presentations for me so that I can guide or coach their 
development. 

58. do their oral presentations for other students in the class. 

59« do their pretetntations for other students in the school or district. 

60. do their presentations for members of their families or for people 
in their'lieighb^rhoods. 

61. prepare their dral assignments for public performance. 

62. prepare their oral assignments for performance in special settings 
(e.g., patients in hospitals, children in special schools, senior 
citizen groups, etc.). 

63. prepare their oral assignments for performance to special school 
personnel (e.g., teachers^ administrators, school boards, etc.). 

64. prepare their oral assignments to be recodrded for sharing with other 
classes at other times. 

65. prepare their oral assignments to be recorded for broadcast on local 
radio afnd/or television programs. 



18 



Pennsylvania Department of Education * S. M. Koziol 
^ - 13 - 

ERIC 



ORAL 
TEACHER 



VI. Oral conposing work can occur in a wide variety of environments or 
contexts. To what extent are any of the following policies or pro- 
cedures included in your oral composing program? 
(0 = Never; 1 = Infrequently; 2 = Sometimes; 3 = Regularly) 

In my oral composing program, I: 

66. identify assignments from the general content students are studying 

67. have studerts select topics for assignments based on their personal 
experiences and preferences'. 

68. identify assignments from topics or issues of current interest. 

69. identify assignments based upon what I know students will be able 
^ to do easily. 

70. select assignments based upon suggestions in the curriculum guide 

or class text. 

71. have all students work on the same kind of assigament at the same 
time 

72. have different students working on different assignments at the same 

time. 

73. ,meet with students individually or in small groups to consider pro- 
gress on assignments before any "formal" presentation is made. 

74. have students meet in pairs or small groups to consider progress 
on assignments before any "formal" presentation is made. 

75. identify for students the specif ic traits or features that mark 
successful completion of the assignment. 

76. make directions for assignments brief and general. 

_ 77. prepare my own presentations based on the assignmentjS I have given 
^ to my students. 
78. participate in students' group presentations wlien asked to or as 

needed. 

79. insist upon absolute quiet by othe^rs in the class when an individual 
or group is "doing" a presentation. 

80. .identify roles or tasks for students in the audience before in- 
dividuals or groups do presentations. 



VII. To what extent are any of the following response or evaluation 
practices emphasized in your class? 

(0 = Never; 1 = Infrequently; 2 = Sometimes; 3 = Regularly) 

As part of the way I evaluate and/or respond to students' oral com- 
posing assignments y I: 

81. give my reactions to the content and/or style of their presentations 
informally after they have finished. 

82. give students my written reactions after they have completed their 
presentations. 

83. point out ways to improve presentations by demonstrating aiyself 
how the changes can be made. 

84. focus my reactions on what the students have done well. 

85. focus my reactions on identifying errors or problems in the 
students' presentations. 
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86. try to balance positive and negative coBunents on students' work. 

87. grade students' oral presentations. 

88. base my grades of students' oral presentations on content only. 

89. base my grades of students' oral presentations on style or delivery 
only. 

90. base my grades of studenti^' oral presentations on the combination 
of content and style and delivery. 

91. assign separate grades on students' oral presentation*: for content 
and for style and delivery. 

92. have students assign grades to their own presentations. 

93. have students assign grades to other students' presentations. 

94'. respond to and/cr evaluate presentations according to clearly defined 
standards or rating scales. 

95. have students respond to other students' presentations according to 
defined standards or rating scales. 

96. use the sane standards and/or rating scales in responding to all 
students ' presentations . 

97. use different standards and/or rating scales in responding to 
different students. 

98. use different standards and/or rating scales in responding to 
different kinds of oral presentations. 

99. involve students in identifying the standards and/or rating scales 
to be used as a basis for responding tj oral presentations. 

100. maintain an analysis profile for each student based upon performance 
on oral composing assignments. 

101. maintain a file with recorded examples of each student's oral work. 
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VIII. To what extent do you participate in any of the following support activities 
for the oral composing program? 

(0 = Never; 1 = Infrequently; 2 = Sometimes; 3 - Regularly) 

102. I prepare my own oral presentations (e.g», poetry reading, dramatic 
readipg, etc.) for my students. 

103. I integrate oral composing activities with other aspects in the 
curriculum and with other programs in the school. 

104, I attend teacher development opportunities (e.g., district in-service, 

college courses, professional workshops, etc.) dealing wich oral com^ 
posing learning and instruction. 

105. I read articles and/or texts dealing with oral composing work in the 

classroom. 

106. I inform school and district administrators ahout classroom needs re- 

lated to the oral composing program. 
^^107. I inform parents about the kinds of oral composing assignments I give , 

to my students. 

108. I inform students and parent? about the oral composing needs in 

different occupational fields. 

109. J inform parents about media presentations related to the school's 

oral composing program. 

110. I inform students and parents about school and/or community per- 
formance^ related to the oral composing program. 
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IV. ASSESSMENT SURVEY III: FOR THE TEACHER RESPONSE FORM 

The Tabulation Guide Outline 



Kach of the PCRP Assessment Survey for the Teachers is intended to repre* 
seiit a covprehensive listing of behaviors in a particular dooiaifi of the Reading 
and CoMunication Arts Curriculum. In the examination of the vast array of 
potential teacher activities, it was evident that, in a number of instances, 
individual behaviors were closely related in form and function. The framework 
of those forms and functions, then, was useful in oirganizing the presentation 
of items in the individual surveys ^^nd provides a coherent base for making 
sense of the data available from these surveys. 

Each of the Tabulation Guides identifies major Sections of each Survey. 
Section 1 in all cases includes items which ask for general background infor* 
mation. Other Sections in the surveys then focus on the broad but important 
dimensions of instruction in the survey domains. Within Sections, items are 
clustered into Factors according to the extent to which they have functional 
similarity or' contribute to illuminating a single classroom feature. Although 
the labels for Factors are quite arbitrary, they are intended tg describe the 
essential functions of features of the two or more behaviors included within 
them. For example, Factor 5 in the Responding to Literature Survey has the 
label. Transmit Cultural Tradition. There are many who see the transmitting of 
a cultural tradition 9r one of the major reasons for including literature in 
the school curriculum, items 3, 9, 13, and 16 in the Responding to Literature 
Survey are purpose statements reflecting that particular kind of orientation to 
literature study. The teacher's responses on items 3, 9, 13, and .16, there* 
fore, can be clustered together and identified as a general indicator of that 
teacher's commitment to the "transmitting of a cultural tradition" as a central 
purpose for literature study in his/her class. ^ 

The Tabulation Guide Outline is presented here only to assist individuals 
or groups in extending their self-reflection on their teaching practices and 
policies in particular domains within the Reading and Communication Arts 
Curriculum. The analysis of responses by Factors or Sections according to the 
Outline is not mandatory but can help to hig|xlight patterns of decision-making 
and practice withir a single class, ^y teachers at a particular grade level, by 
teachers in a particular school, or by teache^rs throughout a district. Further 
details about carrying out these kinds of analyses are provided in the section, 
"Tabulating Individual and Group Data." 



Section I. Background Information ' 

Factor 1. Teacher Batrkgr und (items 1.01-1.03) 

Factor 2. Class Identification (items 1.04**!. 05) 

Factor 3. Allocated Instruction Time (items 1.06-1.07) 

Factor 4. Type and Number of Assignments (items^l.08) 
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Section II. Goals for Oral Composing 

Factor 5 • Intrinsic/Composing Specific (iteips 1, 4, 5, 9) 

Factor 6 - Personal/Social Benefit (items 3, 8, 10, 11) 

Factor 7 - Cognitive/ Applied Skills (items 2, 6, ?, 12) 
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Section III. Precomposing Activities 

Factor 8 - Verbal Interaction (items 13 - 16) 

Factor 9 - Model and Form (items 17 - 21) 

Factor 10 - Personal Preparation (items 22 - 26) 

Factor 11 - Direct Experience (items 27 - 29) 

Factor 12 - Indirect or "Mediated" Experience (items 30 - 32) 

Section IV. Types of Assignments 

Factor 13 - Personal (i..ems 33 - 34) 

Factor 14 - Basic Informational (items 35 - 40) 

Factor 15 - Persuasion (items 41 - 42) 

Factor 16 - Instructional Utility (43 - 46) 

Factor 17 - Creative Expression (items 47-51) 

Factor 18 - Practice Exercises (items 52 - 53) 

Section V. Audiences 



Factor 19 - Self/Close Personal (items 54 - 55) 
Factor 20 - Teacher (items 56-57) 
Factor 21 - Peers/Other Students (itens 58 - 59) 
Factor 22 - Public/Special Audiences (items 60 - 63) 
Factor 23 - Bisplay/Publication (items 64 - 65) 

, Section VI. Oral Composing Environment 

Factor 24 - Selecting Assignments (items 66 - 70) 
Factor 25 - Assignment Differentiation (items 71 - 72) 
Factor 26 - Process Strategies (items 73 - 74) 
Factor 27 - Assignment Making (items 75 - 76) 
Factor 28 - Teacher Participation <items 77 - 78) 
Factor 29 - Audience Preparation (items 79 - 80) 



Section VII. Response and Evaluation 

Factor 30 - Responding to Students' Work (items 81 - 86) 
Factor 31 - Assigning Grades (items 87 * 93) 
Factor 32 - Applying Criteria (items 94 -^99) 
Factor 33 - Follow-Up (items (100 - 101) 

Section VIII. Supporting Work 

Factor 34 - Extending Self - (items 102 - 105) 
Factor 35 - Connecting With Others (items 106 - 110) 
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V. TABULATING RESPONSES FROM THE TEACHER SURVEY 



1. Tabulating Responses on an Individual Survey 

Tabulating responses on one of- the surveys «ay be very helpful for the 
individual teacher. .Each of the surveys is rather lengthy and detailed. 
The tabulation Guides are, especially helpful in directing the teacher's 
attention to patterns in his/her responses on the survey. Key to the 
tabulation of responses are the Tabulation Guide Outlines described in the 
preceding part of this Mnual. 

A. Using the Tabulation Guide for a Single Survey 

Step 1. Using the appropriate Tabulation Guide Outline, record 
the numerical responses (i.e., 0, 1, 2, or 3) for each 
iten within each Factor. 

step 2. Obtain the Sua for the numerical values for .responses 
on each item in a Factor. 

Step 3. Divide. that sum by the number of items in that Factor. 
The resulting score (or Mean) should be between 0.0 
and 3.0. 

B. Sample Calculation for One Factor 

In order to get a general picture of his/her responses on the 
Responding to Literature Survey, a lOth grade teacher decided to 
tabulate his/her responses. For Factor 5, Transmit Cultural 
Tradition, the teacher proceeded as follows: 

Step 1. Items in Factor 5 Response 

3 2 
9 . 1 
13 2 
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Step 2. 2+1+2+1=6 



•Step 3. 6 divided by 4 = 1.5, the Mean for Factor 5. 

(See Part III. for 
further details.) 

^I. Tabulating Group Responses on a Teacher Survey 

Although each Assessment Survey serves a very important pelf-analysis 
function for the individual teacher, each of the surveys also may be used 
to obtaia a general profile for a specific group as well ~ e.g., the 
literature instruction practices of all llth grade college preparatory 
teachers, or the written composing instruction practices of all Ath^nd 
5th gc0(at teachers,' or the supportive behavior for the oral composing 
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component by parents of 7th graders, etc>. That will be a meaningful 
"group" amst be determined at the local school. level. 

A. Tabulating Responses in Section 1 

The rtens in Section 1 'Of the Teacher Survey relate to background or 
contextual aspects of tne group under consideration. The most 
calculation in a simple average for the group on the one or more ^ 
items which are of interest.' 

B. Tabulating Responses in Section 2 

The items in Section 2 of the Teacher Survey provide infonnatioA on 
how time is spent (or genfer^l content choices) within the domain of 
the survey. Tallying the number of responses in each box or cell of 
the charts will yield a frequency distribution for the group of 
teachers. That distribution reflects the pattem(s) of responses by 
the group(s) of teachers. 

C. Tabulating Responses for Section 3 Through 'Section 10 ^ 

Items in Section 3 through Section 10 on each Survey may be examined U 
separately or in clustered groups called Factors.^ As explained in 
the introduction to the Tabulation Guide Outlines, a Factor is a 
label placed upon a group of it^ms that are closely related in form 
or function. For example, on the Written Composing Survey, Factor 3 
is called Verbal Interactive Strategies because each of the four 
items included within it (items 23, 24, 25, and 26) represent class* 
room behaviors" in which some kind of verbal interchange between 
teacher and studjpnts or among students is carried out as a pre*- 
writting strategy. 

0. Calculating Group Heans for Individiial Items 

Step 1. ^ Record the numerical response for each person in the group^ 
Recall that each person has placed a Of, 1, 2, or 3 in the 
space. to the left of each item list«d^ If no response is 
listed on an individual suryey, record a 0 for that person 
on that iltem. 

Step 2. Add the numerical response values for the group. 

Step 3. Divide that sum by the number of individuals in the group. 

The resulting Mean score should fall between 0.0 and 3.0. 

E. Sample Calculation for Group Mean on an Individual Item 

Let us assume that we want to tee how all junior high school teachers 
as a group respond to items on the Written Composing Survey. There 
are 10 Junior high teachers. On item 23, the extent to which they 
led class discussio s on topics before having students write on the 
topics, they responded as follows: 



Step 1. Teacher Responses on item 23 

\ 



Teacher 


Responses on 


1. 


1 


2 


1 


3 




k 


2 


5 


3 


6 


2 


. 7 


2 


8 


3 


9 


1 


10 


1 



Step 2. UH2^^2-^3+2+2-»'3-»^Ul = 18 

Step 3. 18 divided by 10 = 1.8, the Mean Response of this group 

on item 23. (See Part III. for 
, further details.) 

Calculating Group Means for Factors 

Recall that a Factor is, a cluster of individual items that are 
related in form or function. The group H^ans for Factors then can 
provide more direct insight into the groins* practices in a broad, but 
clearly defined aspect of instruction. To calculate the group mean - 
for a Factor, first coq^lete thje calculations for the group on 
individual items, then proceed as follows: ^ 

Step 1. R2>cord> the calculated group means for each of the items in 
the Factor. 

Step 2. Add these luean scores together. 

S^ep 3. Divide the sum by '*the number of items in the Factor. The 
resulting Mean score should' fall between 0.0 and 3'0« 

Sample Calculatioji for Group Mean on a Factor 

Let us assume that, using the context described in E., we wanted to 
see how these 10 junior high teachers responded on the four specific 
types of behavior that are .-^art of Factor 8. We should proceed as 
follows: 

Step 1 . I tems in Factor 8 Calculated Group Mean 

#23 1.80 
#24 }.30 
#25 1.45 
#26 1.45 

Step 2. 1.80^^1.30+1.45^^1.45 = 6.00 . 

Step 3. 6.00 divided by 4 s 1.50, the Group Mean for Factor 8. 
(See Part III. for further details.) 
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III. Interpreting Tabulated Data 



The Mean scores for Factors of individual surveys, for individual items 
for groups of teachers, or for Factors for groups of teachers should not 
be interpreted too literally. These calculations are most useful as 
indicators of the general frequency of a particular behavior or typfe of 
behavior. In general, means of 2..5 - 3.0 reflect a very high degree of 
use; mean jcores between 1.75 - 2.5 reflect a moderate degree of ^ use; mean 
scores between 1.0 - 1.75 reflect a low degree of use; and mean scores 
below 1.0 reflect an extremely low degree of ur»e. Remember too that it is 
operationally imposarible for each teacher to be doing everything in any 
one class on a re^Aar basis. Also, what may be a "good" profile can vary 
dramatically from class to class, can be quite different at different 
grade levels and in all likelihood will reflect marked differences among 
schools or schopl districts. The major issue is determining the extent to 
which the observed profile is appropriate in its o^ context and that 
determination must be made at the local level. ^ 
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VI. ADMINISTERING THE STUDENT SURVEYS 

The student surveys for each of vtjie^five donains in the Survey Package are 
intended for use during class tiae or^s part of large group assessment. 
Although the student forms are considerably shorter than the teacher forms, it 
would still be unwise to. plan to use ©ore than one or perhaps two surveys at 
any one sitting. In general, administration time ranges from about 5 minutes 
per survey for older students wiio arc capable readers to 15 minutes for younger 
students #nd/or less able readers. 

For able readers, a survey can be presented to the group with little 
difficulty. To allay any potential anxiety about the purposes of the assess-- 
Ment, it is helpful to (iXplaia the focus for the survey ^ight at the outset — 
i.e., to highlight that the outcoifce is a description of that particular aspect 
of their curriculum end not an evaluation of their teacher. The results tell 
what was goiag on in the class and not kow well the teacher was carrying out 
those activities. Since^the curticulam includes both the substance studied and 
the learning activities used is part of that study (i.e , both content and 
process), the 'results of the assessment help their teachers and other teachers 
in their schoA examine the ^tual rather than the theoretical curriculum in 
their school and guide those teachers in making decisions about curriculum 
change. The students taking the suryey should also be reminded that this kind 
of description is meaningful only if each person cofq>leting the survey does so 
honestly. 

If s4t|idencs raise, questions about the meaning of particular items or 
words ^ an effort should be made to aisswer the questions simply but without 
bias". That is, in answering a^uestion, ttie person administering the survey 
should avoid any indication of preference or non-preferenc2, approval or 
disapproval. Also, students should be reminded that there will be many items 
on a survey reflecting class activities that they have not done that year. It 
is not likely that any one teacher in any one"" class would use all of the 
activities listed. 

4 

For younger students and/or less able readers, it may be beneficial for 
the persom administering a survey to read aloud each of the items. In ^en^ral, 
with this assist, children, even as young as 2nd graders, seem to be ableU^o 
use the 0, 1, 2, 3 frequency key with little difficulty. As with older au- 
dents, it is also helpful to inform younger students about the general o^oses 
for the survey, to let them know that they can ask questions, and to assure 
ttiem that there will be some activities listed that they have not done or can't 
recall doing during the year or even before. Also, they too should be* reminded 
that they should answer in terms of what jy recall doing not whether they 
liked or disliked the activity. 
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VII. ASSESSMENT SURVEY Ml: STUDENT RESPONSE^^OIRM 

Oral Composing * 

I. Background Infornation f 

a. Teacher's Name 



b. Grade Class Period 



c. School 



d. About how much time ti:ave you spent in oral composing activity 
in your class this year? (Include in your estimate any time 
spent in studying about , preparing; for, doing, and listening 
to students* oral presentations in the classroom.) (check one) 



less than 1 hour per week 

about 1 hour per week 

about 1 and 1/2 hours per week 

about 2 hours per week 

more thaa 2 hours per week 



How much have you yqjirself done this year in oral composing? 
On the checklist below, for each of the thr^e types of assign-* 
ments listed place an X in the box > the right that best 
describes how many times you were expected to do that kind 
pf oral composing assignment during the school year in 
Language Arts/English. ^ 



TYPES OF ASSIGNMENTS 



A PPROXIMATE NTJMBER OF ASS 



gNMENTS 



6+ 



Presentations in which you had to 
Memorize what you had to say ahead 
of time. 



2. Presentations in which you were to 
Prepare (but not memorize) ahead of 
time what you were going to say or 
rea^i aloud and how you were going to 
do it. 



3. Presentations in which you had very 
little or no time to prepare 
(i«e.» improvize ahead of time). 
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II. Purposes for Oral Conposing Instruction 

Teachers can have^awny reasons for wanting you to do or^l composing 
activities. For each statement below, indicate how much you think 
that reason was "esqphasized" by your teacher. On the line to the 
left of each reason^ put a 0 if you think it was not a reason, a 
1 if you think it was a reason net very often, a 2 if it was soae- 
tiiies, and a 3 if it was very often. (Remember, 0 = Not at All; 
1 = Not Very Much; 2 = Sometimes; 3 = Very Much) 

J. The teacher wanted me to develop confidence in myself and m my 

abilities as a speaker. ^ 
2. My teacher wanted me to learn how to use different kinds of 

techniques in giving oral presentations. 

3. My teacher wanted me to develop my organisation and reasoning skills. 

4. My teacher wante^i me to develop the skills in speech I will need as 

an adult. r i • 

5. My jteacher wanted me to better understand my own ideas and feelings. . 

6. My teacher wanted me to understand how specific kinds of speech 
presentations ^aexe done. 



III. Classroom Practices 

Teachers can have you do many things as part of the way they 
work with oral composing in the classroom. We have listed a 
number of things below. Indicate how often your teacher used ^ 
each activity in your class during the year. 

0 = Never ^ 

1 = Not Often, maybe two or three times 

2 = Sometimes, at least five or six times 

3 = Very Often or Regularly during the year 

A. Before we would do our oral composing: 

7. the teacher would lead a class discussion on our topic or subject. 

8. the teacher would have us do whole class or small group "brainstorming 
session on the topic or subject. 
9. the teacher would have us listen to examples or models. 

10. the teacher would have us analyze examples from other students. 

11. the teacher would have us make outlines or detailed notes about 
our presentations. 

12. the teacher would have us jot down impressions or informal notes 

about the content or the delivery of our presentations. 

13. the teacher would lead us in oral warm-up activities. 

14. the teacher would take us on field trips or bring into class things 

relited to our topic or subject. 

15. the teacher would show us films, play records, or use pictures to 

help us get ideas for our presentations. 
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B. Among tbe oral composing assignments: 

16. we gave ''eye-witness" accounts of our observations. 

17. we gave talks about our expeilences or about places, persons, or 
things we had seea or visited. 

18. gwe gave talks explaining our opinions about issues or events. 

19. we gave talkr trying to persuade others to our views. 

20. we gave presentations showing that we had learned required conter** 

21. we gave ''dramatic'' readings of text or our own material. 

22. we would act out scenes or -situations related to course content. 

23. we had to memorize parts in plays. 

24. we had to recite all or parts of poems we had memorized. 

25. we had to give memorized speeches using particular organizations. 

26. we had to give oral presentations using special kinds of speech 
techniques (e.g., pauses, volume shift, humor, etc.). 

' C. When we had to do oral presentation assignments: 

27. we did them for our own personal enjoyment. 

28. we did them for the teacher. | 

29. we did them for other students in ou^ class or school. 

30. we did them for people in our neighb6rhood or district. 

31. we would record them for use on school or local radio. 



D. When we did oral composing work in our class: 

32. we were each given a specific assigiunent by the teacher. 

33. we all worked on tke same kind of assignment. 

34. we could choose our own assignment. 

35. our assignments vere related to content we were studying in class. 

36. \ the teacher gave us clear and definite directions on what to do. 

37. i our teacher worked with us before we actually had to give our 
1 presentations. 

38. i we could practice in small groups before actually giving presentations. 

39. jour teacher would demonstrate how to do assignments before we did 

them. 

40. our teacher gave students in the '^audience" directions on how to 
listen to and what to listen for before we did presentations. 

E. When our oral composing work was evaluated: 

41. jour teacher evaluated our presentations on what we said (CONTENT) 
^ot on how we said it (DELIVERY). 

42. bur teacher evaluated our presentations on Delivery not Content. 

43. our teacher evaluated our presentations on Centent and Delivery. 

44. pur teacher emphasized what we did well. 

45. bur teacher emphasized what we did wrong. 

46. dur teacher would give us grades for oral presentations. 

47. <^ur teachei would have us recommend grades for other students' 
oral presentations. 

48. dur teacher let us know the exact standards that would be used in 
evaluating our presentations. 
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49. our teacher would have us suggest standards that would be used in 
evaluating our presentations. 

50. our teacher would record and keep our oral presentations for later 
use. 
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Vni. ADMINISTRATING THE ADMINISTRATOR AND PARENT SURVEYS 



„... For .4,iai.tr.tor. >»'' PY'":f^'''rs."Jnt fr^rt^ Directions oh 
the five -jor J<«i-'« "J ^.'i'TlhoiU caa.e neither confusion 

eech survey are clear and """i*"' ."r.* „ ^VLj to oarenta for conpletion at 
.or uncertainty. '"^.Xawred ir pelon e^th« Individrily or in 

Jru;..°%t''".lou"d"taLtt;"'irua no lo^,er than four or five .inutes to 
coi^lete a survey. 

If an ir.-per.oo '^^■'^'-"^^''^''^^'^'^^^^^ 
r«iiad the .d.ini.tr.tor and/or parent «">* " ^ JJ^/' ' OM person is not 

tne systefi. 
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IX. ASSESSMENT SURVEY III: ADMINISTRATOR RESPONSE FORM 

Oral Composing 



NAHE or Code # 
Date 



Directions: Oral c<MPposing activities include oral presentations that are 
aenorized, prepared , or spontaneous and can range from giving 
oral reports,, expressing opinions or positions, doing poetry 
readings, acting in plays, taking part in dramatic readings, 
etc. As a school administrator, there are many things that 
you can do to support^ this aspect of the school curriculum. 
Some of these are listed below. In the space provided to the 
left of each statement, please indicate your estimate af how 
often you do or provide each behavior listed. 

0 = Sever - means that this is not something you 

do or provide during the year. 

1 = Infrequently - means that this may be something you 

do or provide perhaps once or twice 
during the year. 

2 = Sometimes - means that this is something you may 

do or provide as many ^s five or sixl^ 
times during the year. 

3 = Regularly - means that this is something you may 

do or provide frequently during the year, 

1. I 



read or present things orally to students during the school day. 

2. I take part in dramatic readings in school with students and/or staff 

3. I take part in amateur or professional creative work (e.g., theatre 
groups, radio play groups, poetry readings, etc.) in our comunity. 

4. In clubs or groups in the community, I take roles which involve my 
sharing opinions and views, publically. 

5. I attend at school and/or in th€ community a variety o£ creative 
and/or informational oral presentations. 

6. I- inform students and 9taff about oral composing events in the 
community or on the radio. 

7. I inform parents about oral composing events in the cownunity or 
on the radio. 

8. I support teacher requests to attend professional development 
sessions dealing with aspects cf oral composing. 

9. I encourage staff meabers to realize uhat they have a responsibility 
for helping students develop their orai composing abilities. 
I support efforts to bring to the school a variety of people to do 
perfonwnces or to talk with students about the nature of oral com- 
posing work. 

I support teachers' efforts to use a varisty of facilities to en- 
hance students' experiences in oral coflq>osing. 
12. I support teacher and students efforts to record and/or display 
students' oral coaqiosing work. 
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X. ASSESSMENT SURVEY III: PARENTS RESPONSE FORM 

Oraf Composing 



Child's First Vame ^ 

Child's grade level 

Directions: Oral composing means oral presentations that are membrized, pre- 
pared, or spontaneous* These oral presentations include things 
such as oral reports, expressing opinions or views, doing dramatic 
readings, etc. As a parent, there are many things that you may 
do to support the oral composing part of the school program.^ We 
haye listed some of these activities be?.ow. In the space to the 
left of eath statement, please indicate your estimate of how often 
you do or provide what is listed. 

0 = Never - means that this is not something you 

do or provide during the year. 

1 = Inf equently - means that this may be something you 

do or provide perhaps once or twice 
during the year. 
* 2 = Sometimes - means that this is something you may 

do or provide as many as five or six 
times during the year. 
3 Regularly - means that this is something you may , 

do or provide frequently during the year. 

1. I read things orally to or with my child. 

2. I take part in local amateur or professional theatre groups or 

"radio play" groups* 
3. I do oral recordings of opinions or views for possible broadcast 

on local radio or television. 
4. In local groups or clubs, I t^ake roles which enable me to express 

my views or opinions publically. 
5. I talk with my child about the kinds of oral composing assignments 

that are required for school. 

6. I help my child prepare for oral composing assignments. 

7. I take my child to oral presentations at school or in the community. 

'ZZZ. 8- ^ ^^^^ ^^^^ ^ child about tbe oral presentations that we hear together 
9. I encourage my child to take part in oral composing activities outside 

of the classroom or school. 
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